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USER PROFILE INFORMATION DATA STRUCTURE BASED ON USER 
PREFERENCE AND MULTIMEDIA DATA BROWSING SYSTEM USING THE 
SAME 

5 BACKGROUND OF THE INVENTION 
1 . Field of the Invention 

The present invention relates to an user profile information data structure 
for browsing of multimedia data and a multimedia browsing method using the 
3 K) .same, and more particularly, to a content-based multimedia data indexing and 
browsing system in which an user-preferred browsing method is contained in an 
-^1 user profile, and multimedia browsing based on user preference is provided using 

21 an user-preferred browsing information contained in this profile, in implementing 

multimedia data browsing. 

JI 2. Description of the Background Art 

U In multimedia data indexing and browsing in the conventional art, there 

have been introduced techniques for variously displaying multimedia data based 
on user preference. 

20 In internet shopping by using of a multimedia data indexing and browsing 

system based on user preference, there is a method of selecting only preferred 
items stored in an user profile by each user and displaying each product in a 
different way, not displaying all information items used in the internet shopping. 

For example, in the case that some user mainly uses price and specification 

25 information, some user mainly uses design information, and some user mainly 
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uses product information of a certain particular company in checking electronic 
products through the internet shopping, each user is given the above preferred 
information as its own user profile. In case that an user mainly uses price' and 
specification in this preferred information, merely the information containing only 
3 price and specification is displayed to the user although other information such as 
photographs is provided by the user. And, in case of an user who prefers design 
information, design(photDgraph) information is mainly displayed- In this way, the 
information appropriate for the preference of each user is displayed. 

In addition, there have been introduced techniques for providing a terminal 
Id desk-top interface such as a computer to an user in an user-desired form in a 
muftimedia indexing and browsing system based on user preference in the 
conventional art. 

In other words, the terminal desMop interface that the corresponding user 
prefers (or designates) is recorded in its user profile, and then the form of the 
15 interface stored in the corresponding user profile is provided to the user 

Besides, there have been techniques for supporting help information in the 
form that user prefers using the recorded usage pattern of user in another 
conventional art. 

The above-mentioned techniques considering user preference(use pattern) 
20 in the conventional art all reflects partial user preference in the current restricted 
application. 

Nowadays, the content description is described in the data for supporting 
the content-based multimedia indexing/browsing. In the case the vahous browsing 
method are possible, so if there is the information describing user preference, user 
25 can browse multimedia data in the preferred browsing method using preferred 
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browser 

In other words, among a variety of browsers for performing content-based 
multimedia data indexing and browsing, there may be browsers that is particularly 
preferred, or browsers that is preferred by the type of multimedia data to the user, 
5 However, since the maintenance and management of such data is not achieved, 
the user cannot enjoy his or her right to various selection, but also must be 
satisfied with parts of the browsers restrictivejy provided in a given environment, 

SUMMARY OF THE INVENTION 

III Accordingly it is an object of the present invention to provide a user profile 

Q information structure in which multimedia data indexing and browsing can be 

,,3"'^ implemented in an user-preferred browsing form, and a multimedia data browsing 

method using the same. 
2 15 It is another object of the present invention to provide an user profile 

information structure in which an user-preferred browsing method is contained, for 
p displaying the multimedia data in an user preferred form, and a multimedia data 

browsing method using the same, In implementing multimedia data indexing and 

browsing. 

20 It is another object of the present Invention to provide an user profile 

information structure in which an user-preferred browsing method is checked from 
an user profile, and an application(or browser) is designated according to user 
preference if there are plurality of applications providing the corresponding 
browsing method, or an application satisfying the corresponding service Is 

25 downloaded from other designated place and is provided to the user if there is not 

3 
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such an application^ and a multimedia data browsing method using the same. 

To achieve the above objects, in content-based multimedia data browsing, 
there is provided an user profile information structure according to the present 
invention, which includes an user-preferred application description scheme for 
3 browsing in an user profile, in order to provide an user-preferred multimedia 
browsing method. 

In addition, the user-preferred application description scheme stored in the 
user profile is an application ID, or application locator 

In addition, the application description scheme stored in the above user 
5 10 profile further includes a layout description scheme of an application. 

In addition, the number of user-preferred application description schemes 
,1: stored in the user profile may be plural, and each of the application description 

' schemes further includes a weight describing user preference. 

In addition, the user-preferred application description schemes stored in 
15 the user profile are different from one another according to the type(genre) of a 
|I multimedia data object, each of the application description schemes is structured 

J5 hierarchically, and the part of the application description scheme having a weight 

describing scheme based on user preference. 

To achieve the above objects of the present invention, in contents* 
20 based multimedia data browsing, there is provided a multimedia data browsing 
method according to the present invention which is characterized in that: (a) 
multimedia data contains a contents description scheme for indexing/browsing 
multimedia data; (b) an user profile includes an user preference description 
scheme indicating an user-preferred multimedia browsing method or browsing 
25 criterion as an application description scheme for user-preferred browsing; and (c) 
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multimedia data is browsed based on the user-preferred application description 
scheme for user-preferred browsing in a corresponding user profile, if the user 
desires multimedia browsing. ' In addition, in the multimedia data browsing 
method of the present invention, the user-preferred multimedia data browsing 
5 method or browsing criterion are described differently according to the type or 
genre of multimedia data, and a multimedia data is browsed based on the 
description scheme describing each user-preferred browsing method or browsing 
criterion. 

In addition, in the multimedia data browsing method of the present 
.5 10 invention, the user-preferred muftimedia browsing method or browsing criterion is 
a character-oriented browsing^ character/place relation-oriented browsing, time 
yi sequential and scene-oriented browsing, or combination thereof. 

^■^ In addition, in the multimedia data browsing method of the present 

invention, the number of browsing method or browsing criterion described 
15 differently according to the type of multimedia data may be one or plural with 
respect to one type(genre) thereof^ and weighted values can be added on these 
browsing methods or browsing criteria. 

In addition, in the multimedia data browsing method of the present 
invention, if there is no application satisfying the user-preferred multimedia 
20 browsing method or browsing criterion in the current terminal, in displaying the 
corresponding multimedia data, such an application is downloaded(or plugged-in) 
for thereby implementing the same. 

In addition, in the multimedia data browsing method of the present 
invention^ if there are a plurality of applications satisfying the user-preferred 
25 multimedia browsing method or browsing criterion in the current terminal, in 

5 
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displaying the corresponding multimedia object based on the user-preferred 
multimedia browsing method or browsing criterion, a locator of an application or 
browser is included so as to select an appropriate application among the plurality 
of applications, and the multimedia object Is displayed by selecting the application 
5 indicated by the locator of the application or browser 

Additional advantages, objects and features of the invention will become 
more apparent from the description which follows. 



BRIEF DESCRIPTION OF THE DRAWINGS 

s 

The present invention will become better understood with reference to the 
accompanying drawings which are given only by way of illustration and thus are 
ji not limitative of the present invention, wherein; 

- Figure 1 is a schematic view illustrating the construction of a multimedia 

,g 15 system according to the present invention; 

5™ Figure 2 is a view illustrating an example of a contents description scheme 

Q structure of a multimedia object according to the present invention; 

Figure 3 is a view illustrating an user profile information data structure 
according to a first embodiment of the present invention; 
20 Figure 4 is a view illustrating an user profile information data structure 

according to a second embodiment of the present invention; 

Figure 5 is a view illustrating a preference description scheme in an user 
profile information data structure according to the present invention; 

Figure 6 is a view illustrating an example of a browsing based on user 
25 preference; 

6 
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Figure 7 is a view illustrating another example of a preference description 
scheme in an user profile information data structure according to the present 
invention; and 

Figure 8 is a view illustrating another example of a browsing based on user 
5 preference. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The preferred embodiments of the present invention will now be described 
io in detail with reference to the accompanying drawings. 

First, Figure 1 is a schematic view illustrating an example of the 
construction of a multimedia data service system according to the present 
invention; 

A multimedia object 101 has a contents description 101a for content-based 
15 indexing/browsing and a data stream 101b. 

A terminal 102 includes a central processing unit 103 for performing 
content-based multimedia indexing and browsing control, a memory 104 for 
storing a variety of data, a display device 105 for displaying various information 
relating to multimedia data indexing and browsing, an user profile reader 106 for 
20 reading user profile information, and an user profile. 

Here, the user profile reader 106 can have the function of a writer for 
updating information recorded in the user profile 107 based on the feedback of an 
user. 

In addition, the user profile 107 can be a movable medium capable of 
25 recording and storing information in the form of a smart card. 

In addition, an user-preferred browsing method or browsing criterion is 
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described in the user profile 107, and such information can be updated by learning. 

The information contained In the user profile 107 is read out from the user 
profile reader 106, and is downloaded to the memory 104. 

The central processing unit 103 decodes the user profile information 
5 downloaded to the memory 104 to thus browse the multimedia object 101 using 
the corresponding display device 105 by the user-preferred browsing method or 
browsing criterion. 

Figure 2 is a view illustrating an example of a contents description scheme 
structure of a multimedia object for content-based indexing/browsing according to 
10 the present invention. 

The contents description scheme structure has an audio visual description 
scheme 201 including a syntactic DS 202 and a semantic DS 203. The syntactic 
DS 202 includes a segment DS 204, region DS 205, and segment/region relational 
graph DS 206. The semantic DS 203 includes an event DS 207. object DS 208. 
15 and event/object relational graph DS 209, 

The syntactic DS 202 describes a physical structure of actual multimedia 
data, and has segments and regions of the actual multimedia data and information 
on the relation(link) between them, thus making it possible to index and browse a 
corresponding section or scene of the multimedia data. 
20 The semantic DS 203 describes a semantic structure of multimedia data. In 

case of a multimedia data, for example, moving pictures such as drama, events, 
objects(characters, places, etc,), and the relation between events and characters 
or places are described, thus enabling content-based indexing and browsing of 
multimedia data. 

25 The description scheme structure of the multimedia data for content-based 

multimedia data indexing and browsing is not limited to that as shown in Figure 2, 



8 



09-21 08:23 THU FROMrPPRK KIM a PARTNER 8E254S6S51 



TO: 7035029596 



PAGE: IT 



and can be varied in various forms for the purpose of more effective browsing. 

Figure 3 is a view illustrating an user profile information data structure for 
content-based multimedia data browsing according to a first embodiment of the 
present invention; 

5 The user profile information data structure has a data browsing DS 301 

including data type DS 302 and a browsing preference DS 303. Such a data 
browsing DS structure can be given by the type or genre of each multimedia 
object. 

The browsing preference DS 303 corresponds to the data type DS 302. 
D 10 The browsing preference DS 303 includes a browser DS 308 as an 

01 application DS satisfying user preference and a functionality DS 304 for describing 

a browsing method or browsing criterion. 
ti The functionality DS 304 for describing a browsing method or browsing 

^ criterion has a reference to browser DS 305 for connecting a corresponding 

O 15 browser, a function DS 306 for selecting a browser, and a weight DS 307 for 
ry describing a corresponding weight value, 

:!: The application DS 308 has a weight DS 309, locator DS 310, and 

3 reference to functionality DS 311 for reference to a description scheme for 

describing a browsing method or standard. 
20 Therefore, by means of the user profile relating to such a user-preferred 

browsing method(or browsing criterion), it is possible to display a certain particular 

multimedia data by the user-preferred browsing method or standard in a system of 

Figures 1 and 2. 

In other words, vi^hen an user displays a multimedia data based on the user 
25 profile information, a corresponding application{browser) satisfying description 
schemes 304 through 307 for describing the user-preferred browsing method or 
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Standard for the corre^onding data, or having been described in the application 
description schemes 308 through 311 is indexed in the terminal. 

tf the corresponding appiication exists in the terminal, multimedia data is 
displayed using the same, or if it does not exist in the terminal, the corresponding 
5 application is downloaded using the locator DS 310. 

In addition, the number of appl)cation(browser) included in the application 
DS is one or more than one. If the number of application Is plural, an user- 
preferred appfication is employed using the weight DS 309 which is learned based 
on user prefer©nce(user feedback/user's usage pattern of a certain particular 
y 10 browser) for each application. 

IP Figure 4 is a view illustrating an user profile information data structure for 

SI content-based multimedia browsing according to a second embodiment of the 

present invention, which is formed by further including a layout description scheme 
'^^^ of a browser in addition to the structure as described in Figure 3. In this case, the 

Q 15 user can describe preference on a browser according to a certain particular type of 
ill multimedia data, but also can describe layout preference DS of the corresponding 

browser, 

Q As illustrated in Figure 4, the user pnDfile information data stnjcture has a 

data browsing DS 401 including a data type DS 402 and a browsing preference 
20 DS 403. Such a data browsing DS structure can be given by the type or genre of 
each multimedia data. 

The browsing preference DS 403 corresponds to the data type DS 402. 
The browsing preference DS 403 includes a browser DS 408 as an 
application DS satisfying user preference, a functionality DS 404 for describing a 
25 browsing method or browsing criterion, and a layout DS 413 of the browser. 

The functionality DS 404 for describing a browsing method or browsing 

10 
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criterion has 3 reference to browser DS 405 for reference to a corresponding 
browser, a function DS 406 for selecting a browser, and a weight DS 407 for 
describing a corresponding weight value. 

The application DS 408 has a weight DS 409, locator DS 410, reference to 
functionality DS 411 for reference to a description scheme for describing a 
browsing method or standard, and reference to layout DS 412 for layout.. 

The layout DS 413 has a weight DS 414 for the layout and a reference to 
browser DS 416 for reference to the browser 

Therefore, by means of the user profile relating to such a user-preferred 
browsing method{or browsing criterion), it is possible to display a certain particular 
multimedia data by the user-preferred browsing method or standard in a system of 
Figures 1 and 2. In addition, the layout preference DS of the corresponding 
browser can be described. 

In other words, when an user displays a multimedia data based on the user 
profile information, a corresponding appticatfon(browser) satisfying description 
schemes 404 through 407 for describing the user-preferred browsing method or 
standard for the corresponding object, or having been described in the application 
description schemes 408 through 411 is indexed in the terminal. 

At this time, an user-preferred layout of the browser is displayed using the 
layout DS 41 3 through 416 and the reference to layout DS 412 in the browser DS. 

If the corresponding application exists in the terminal, multimedia data is 
displayed using the same, or if it does not exist in the terminal, the corresponding 
application is downloaded using the locator DS 410. 

In addition, the number of application(browser) included in the application 
DS is one or more than one. If the number of application is plural, an user- 
preferred application is employed using the weight DS 409 which is learned based 

u 
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on user preference for each application. 

Figure 5 is a view illustrating a description scheme of a browsing method or 
criterion in an user profile information data structure as shown in Figure 3 or 
Figure 4 according to a first embodiment of the present invention. 
5 The structure of Figure 5 is a function description scheme structure for 

indexing and displaying a corresponding multimedia data based on 
character/relation, and includes a basic key item 501 and an order of key item 502, 

The basic key item describes browsing on the basis of character and 
relation 503 and 504, Figure 6 illustrates an example of a browsing according to 
10 such a scheme structure. 

As shown in a video browser(user interface) of Figure 6, a character screen 
unit 602 of -a character relational screen unit 601 displays characters, and a 
character-relation screen unit 603 displays character-relation satisfying a relation 
which is selected here. 
15 In addition, a main scene screen unit 604 displays main scenes satisfying 

the corresponding relation in key frames 604a. Here, tt is shown that a main 
screen unit 606 displays a selected particular scene in more detail. 

Figure 7 is a view illustrating- a description scheme of a browsing method or 
criterion in an user profile information data as shown in Figure 3 or Figure 4 
20 according to a second embodiment of the present invention. 

The structure of Figure 7 is a function description scheme structure for 
displaying a corresponding multimedia data using a 3-level tree in time sequential 
key frames^ and includes a basic key item 701 and an order of key item 702. 

The basic key item describes browsing on the basis of key frames, and the 
25 order of key item 702 describes time sequential browsing, and describes that the 
basic key item has a hierarchical structure(depth of key item, level 1=3.., 
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Figure 8 is a view illustrating an example of an interface of a browser using 
the function description scheme structure of Figure 7, 

As shown in a video browser(user interface) of Figure 8, a key frame unit 
601 displays multimedia contents in key frames in a time sequence, and a main 
5 screen unit 802 displays a section which is selected here and is represented by 
key frames. 

According to the user profile information data structure and browsing 
method using the same of the present invention, while implementing content- 
based moving picture indexing and browsing, an user-preferred browsing 
lu method(application) can be provided by each corresponding multimedia data. 

Therefore, with respect to a multimedia data selected by the user, the user- 
preferred browser(application) can display the corresponding multimedia data. 

In addition, in the present invention, since the corresponding multimedia 
data is indexed and browsed by a browser which is close or identical to the user- 
15 preferred browsing method(applicatton), an user-friendly and user-adaptive 
indexing and browsing environment can be provided when multimedia data is 
indexed and browsed based on contents. 

As the present invention may be embodied in several forms without 
departing from the spirit or essential characteristics thereof^ it should also be 
20 understood that the above-described embodiments are not limited by any of the 
details of the foregoing description, unless othenA^ise specified, but rather should 
be construed broadly within its spirit and scope as defined in the appended claims, 
and therefore all changes and modifications that fall within the meets and bounds 
of the claims, or equivalence of such meets and bounds are therefore intended to 
25 be embraced by the appended claims. 
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What is claimed is; 

1. In a content-based multimedia data browsing, an user profile 
information data structure comprises an user-preferred application description 

s scheme for browsing in an user profile in order to provide an user-preferred 
multimedia browsing method, 

2. The user profile information data structure of claim 1, wherein the 
user-preferred application description scheme stored in the user, profile is an 

10 application ID. or application locator 

^2 3. The user profile information data structure of claim 2, wherein the 

j-J application description scheme stored in the user profile further comprises a layout 

description scheme of applications. 

l2 4. The user profile information data structure of claim 1 , wherein the 

Jz: number of user-preferred application description schemes stored in the user profile 

may be pluraJ, and each of the application description schemes further comprises 

a weight for describing user preference. 

20 

5, The user profile information data structure of claim 1 or 4, wherein 
the user-preferred application description scheme stored in the user profile may be 
a plurality of application description schemes which are different from one another 
according to the type(genre) of a multimedia data object, and each of the plurality 
25 of application description schemes further comprises a weight describing user 

14 
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preference corresponding to an user feedback. 

6. The user profile information data structure of claim 5, wherein 
each of the user-preferred application description schemes is structured 
hierarchically, and each part of the description schemes has a weight describing 
user preference. 

7. In content-based multimedia data browsing, a multimedia data 
browsing method, characterized In that: 

(a) multimedia data contains a contents description scheme used in 
indexing/browsing multimedia data; 

(b) an user profile includes an user preference description scheme 
indicating an user-preferred multimedia browsing method or browsing criterion 
for user-preferred browsing; and 

(c) mLiltimedia data is browsed by analyzing the user-preferred application 
description scheme for user-preferred browsing in a corresponding user profile, if 
the user desires multimedia browsing. 

8. The method of claim 7, wherein the user-preferred multimedia 
data browsing method or browsing criterion are described differently according to 
the type or genre of multimedia data, and the multimedia data is browsed 
according to the corresponding description scheme indicating each user-preferred 
browsing method or browsing criterion. 

9. The method of claim 7 or 8, wherein the user-preferred multimedia 
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browsing method or browsing criterion is represented as a character-oriented 
browsing, character/place relation-oriented browsing, time sequential and scene- 
oriented browsing, or combination thereof. 

5 1 0. The method of claim' 8, wherein the number of browsing methods 

or browsing criteria described differently according to the type of multimedia data 
is at least more than one with respect to one type(genre) thereof, and weighted 
values can be added on each of the browsing methods or browsing criteria, thus 
analyzing the user-preferred application. 

10 

Ji: 11 , The method of claim 7, wherein an application satisfying the user- 

j preferred browsing method or browsing criterion is executed the locator 

H description scheme of the corresponding application, in displaying the 

s: corresponding multimedia data. 

~J 12. The method of claim 11, wherein, if the proper application for 

y browsing does not exist in the terminal, the corresponding application is 

downloaded using the locator description scheme. 

20 
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ABSTRACT OF THE DISCLOSURE 

The present invention relates to an user profile information data structure 
for browsing of multimedia data and a multimedia browsing method using the 
same. 

The multimedia data browsing method is characterized in that: (a) multimedia data 
contains a contents description scheme for indexing/browsing based on contents: 
(b) an user profile includes an user preference description scheme indicating an 
user-preferred multimedia browsing method or browsing criterion; and (c) 
multimedia data is browsed by analyzing the user-preferred application description 
scheme for user-preferred browsing in a corresponding user profile, if the user 
desires multimedia browsing. 
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Functional ity 
501 ^^<Basic Key Item> 

503 -<Key-Iteni l>="Character"</Key-Iteni 1> 

504 ^<Key-Iteii! 2>="Relation between Key-Item r'</Key-Item l'^ 

</Basic Key Itrm> 

502-^-<0rder of Key Item> 

<Key-Itein l>='priority" </Key-Itejn 1> 
<Key-Item 2>='^priori ty" </Key-Iten] 1> 
</Order of Key Iteiii> 
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FIG. 7 



Funct ional i ty 
■ <8asic Key Item> 

.<[Cey-Item l>=*'key-frame"</key-[tem L> 

</Basic Key Itrm> 
'Order of Key Itein> 

— — ^<Key-Item l>="titne'* </Key-Itefn 1> 
</Order of Key Item> 
<Depth of key Itein> 

<level 1>="3" </level 1> 
</Deplh of key Ue[n> 
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Michael J. Corntiljiion, flcgibtradtJn No. 4<).3^5; And Sturfrt I, Smith, Rt:gistfation No. 42,159; and C;(irtjl L. Druzbick, Rcgistraiion No. 40.287. 
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P. O, Box 221200 
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I Mill name of sole Qr first inventor: Jin Soo LEE 
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